[FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely #4044
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Would @lvyanquan like to take a look? |
tchivs
pushed a commit
to tchivs/flink-cdc
that referenced
this pull request
Aug 10, 2025
Mrart
pushed a commit
to Mrart/flink-cdc
that referenced
this pull request
Aug 14, 2025
…rematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types
Mrart
added a commit
to Mrart/flink-cdc
that referenced
this pull request
Aug 14, 2025
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <[email protected]> * add: comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <[email protected]> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <[email protected]> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <[email protected]> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <[email protected]> back
Mrart
added a commit
to Mrart/flink-cdc
that referenced
this pull request
Aug 14, 2025
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <[email protected]> * add: comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <[email protected]> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <[email protected]> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <[email protected]> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <[email protected]> back
Mrart
added a commit
to Mrart/flink-cdc
that referenced
this pull request
Aug 14, 2025
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <[email protected]> * add: comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <[email protected]> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <[email protected]> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <[email protected]> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <[email protected]> back
Mrart
added a commit
to Mrart/flink-cdc
that referenced
this pull request
Aug 19, 2025
[FLINK-38141][pipeline-connector/iceberg] Fix iceberg connector incorrect type mapping (apache#4070) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [minor] Fix potential sql connection statement issue (apache#4069) [FLINK-38185][pipeline-connector][iceberg] Correctly handle the type conversion of TIMESTAMP_TITH_TIME_ZONE. (apache#4074) [tests][pipeline-connector/fluss] Add MySQL to Fluss E2e IT case (apache#4057) * [ci][fluss] Add MySQL to Fluss E2e IT case Signed-off-by: yuxiqian <[email protected]> * add: comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38184] one time of GetCopyOfBuffer is enough When serializing split. (apache#4073) [FLINK-38164][pipeline-connector/mysql] support mysql long and long varchar type (apache#4076) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37828] Enable scan.incremental.snapshot.unbounded-chunk-first by default for improved stability (apache#4082) [FLINK-38194][pipeline-connector/iceberg] Iceberg connector supports auto-creating namespace (apache#4080) --------- Co-authored-by: zhangchao.doovvv <[email protected]> [FLINK-37905][runtime] Fix transform failure with non-ascii string literals (apache#4038) * [FLINK-37905] Fix transform failure with non-ascii string literals * address comments Signed-off-by: yuxiqian <[email protected]> --------- Signed-off-by: yuxiqian <[email protected]> [FLINK-38142] Upgrading the Paimon version to 1.2.0 (apache#4066) [FLINK-37963] Fix potential NPE when triggering JobManager failover prematurely (apache#4044) fixed decimal add test fixed decimal mode test add all types [FLINK-38059][doc] Add fluss pipeline connector documentation (apache#4088) Co-authored-by: wangjunbo <[email protected]> [FLINK-37835] Fix NoPointException when start with latest-offset. (apache#4091) --------- Co-authored-by: wuzexian <[email protected]> [FLINK-38188][pipeline-connector][postgres] Fix database name validation logic in PostgresDataSourceFactory (apache#4075) --------- Co-authored-by: lvyanquan <[email protected]> [hotfix][doc] Update uses of Upload documentation in build_docs.yml. (apache#4093) [FLINK-38204][pipeline-connector][maxcompute] Use getLatestEvolvedSchema to get Schema in SessionManageOperator in case of using route. apache#4094 Co-authored-by: wuzexian <[email protected]> back
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This closes FLINK-37963.
Occasionally, test cases related to triggering JM failover might fail, with an NPE thrown when manipulating jobManagerLeaderServices (like https://github.com/apache/flink-cdc/actions/runs/15509047609/job/43667549280).
It is likely to be caused by uninitialised JobManagerService and could be circumvented by invoking
EmbeddedHaServices#getOrCreateJobManagerServicemanually.